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TRUNCATIONS OF HAAR DISTRIBUTED MATRICES, 
TRACES AND BIVARIATE BROWNIAN BRIDGE 

C. DONATI-MARTIN AND A. ROUAULT 



Abstract. Let U he a. Haar distributed matrix in U(n) or 0(n). We 
t^, show tiiat after centering the two-parameter process 



on: w^"\s,t)= Yl \u^^ 



i< [nsj ,j < [ntj 

converges in distribution to the bivariate tied-down Brownian bridge. 



Ph ■ 1. Introduction 

xi ■ 

-4— > . Let o" be a random permutation uniformly distributed on the symmetric 

group Sn- Define for p,q < n 

^i",)=#{l<i<P, aii)<q}. 

'^ I In [7], G. Chapuy proved that a suitable normalization of Xp^g converges in 

\^ I distribution to the bivariate tied-down Brownian bridge. Note that Xp^g = 

^ ■ Tr(Sp^qS* q) where Sp^g is the truncated matrix of size p x q oi T,, the per- 

' mutation matrix associated with a, and * means adjoint. In this paper, we 

prove a similar result when the symmetric group is replaced by the unitary 
Q . group or the orthogonal group, equipped with the Haar measure. 

(^ I Let [/ be a Haar unitary, resp. orthogonal, matrix in U(n), resp. in 0(n). 

We consider, foip<n and q < n, the upper-left p x q submatrix Vp^g and 

the p X p Hermitian matrix 



-"p.g — ^p,q Vp^g ■ 



C^ ■ We are interested in the asymptotic behavior of 

Tp^g = TTHp^g= Y, |[/i,,f. (1.1) 

Setting 

we define a sequence of two-parameter processes W^"^' by 

Date: September 20, 2011. 

2010 Mathematics Subject Classification. Primary 15B52, 60F17; Secondary 46L54. 
Key words and phrases. Random Matrices, unitary ensemble, bivariate Brownian 
bridge, invariance principle. 

1 



2 C. DONATI-MARTIN AND A. ROUAULT 

Chapuy used the space C([0, 1]^) completing its process in such a way that 
it is continuous and affine on each closed " lattice triangle" . We prefer using 
the multidimensional generalization of Skorokhod space D{[0, 1]^) given by 
[5]. It consists of functions from [0, 1]^ to M which are at each point right 
continuous (with respect to the natural partial order of [0,1]^) and admit 
limits in all "orthants". The space D{[0, l]"^) is endowed with the topology 
of Skorokhod (see [5j for the definition). 
Our main result is the following 

Theorem 1.1. The process W^"^' converges in distribution in D{[0, 1]^) to a 
tied-down Brownian bridge a/«W^ where W^'^' is a centered continuous 
Gaussian process on [0, 1]^ of covariance 

E[VF(°°) {s, t)M^(~) [s, t')] = {s^s' - ss'){t At' - tt'), 
13 = 2 in the unitary case and (3 = \ in the orthogonal case. 

Previous works are related to our problem. First, Borel in 1906 shows that 
for a uniformly distributed point on the (n — l)-dimensional (real) sphere, 
the scaled first coordinate converges in distribution to the standard normal. 
Since that time, many authors studied the entries and partial traces of ma- 
trices from the orthogonal and unitary group. In particular Diaconis and 
d'Aristotile ([El [IS]) proved that the sequence of one-parameter processes 

\ns\ 

Y^Uii, se [0, 1] 

converges in distribution to the complex Brownian motion. Besides, Silver- 
stein [26j proved that for q fixed, the sequence of one-parameter processes 

[nsj 

n'/\^\U,g\^-s), se[0,l]\ (1.2) 

1=1 

/ n 

converges in distribution to the Brownian bridge. 

In the paper ^27j, Silverstein discussed the similarity between the matrix 
of eigenvectors of a (real) sample covariance matrix and a Haar distributed 
orthogonal matrix, with a one-parameter parameter process analogous to 
(jl.2p . We also refer to [2", Chapter 10] for the behavior of eigenvectors of 
sample covariance matrices and universality conjectures. To extend this 
study and after reading a first draft of our result, Djalil Chafai conjectured 
that if M is a n X n matrix with i.i.d. entries having the same four first 
moments as the complex Gaussian standard and if ZY denotes the matrix of 
eigenvectors of A'' = MM*, then the sequence W'"^ obtained by changing 
Uij into Uij converges to the tied-down Brownian bridge as in Theorem ll.il 
At the moment of posting the present version, we are aware that Florent 
Benaych- Georges ([4J) answered positively to the conjecture when A^ is a 
Wigner matrix, under a fourth moment hypothesis. 
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The rest of the paper is organized as follows. In section 2, we introduce the 
basic notions on permutations, partitions, classical cumulants. The paper 
is then split into two parts. Section 3 deals with the unitary case and 
Section 4 is devoted to the orthogonal case. In each part, we develop the 
combinatorics associated with the groupj (the Weingarten function and the 
associated cumulants). 

In particular, we state a formula for the cumulants of variables of the 
form X = Tr{AUBU*) for deterministic matrices A, B of size n. In the 
unitary case, the formula follows from the results of [21] . We then apply 
the above formula to the computation of the second and fourth cumulants 
of Tp^q. The proof of Theorem 11.11 is then divided in two parts: tightness of 
the family of distributions of W^"^' and convergence of the finite dimensional 
laws. To prove the tightness, we use a criterion of Bickel and Wichura for 
two-parameter processes, with the help of the estimates obtained in section 
3.2, resp 4.3. The convergence of the finite dimensional distributions to 
Gaussian distributions relies on the computations of their cumulants and 
their asymptotics. The expression of the cumulants follows from the previous 
section and their limit follows from the asymptotics of cumulants of unitary, 
resp. orthogonal, Weingarten functions, obtained in |8j, resp. [IT]. Let us 
mention that simultaneously and independently of the present paper, precise 
computations in the orthogonal case are presented in [23] and [23] . In section 
5, we give complementary remarks and connections with other problems. 



2. Preliminaries 
For n a positive integer we set [n] := {1, 2, • • • , n}. 

2.1. Partitions, permutations. We call A = {Ai, • • • , Ag} a partition of 
[k] if the Ai {\ <i < s) are pairly disjoint, non-void subsets of [k] such that 
AiU ■■■U As = [k]. We call Ai, • • • ,As the blocks of A. The number of 
blocks of A is denoted by #(A). The set of all partitions of [k] is denoted by 
V{k). One partition A is said to refine another B, denoted A < B provided 
every block of A is contained in some block of B. Given two partitions A 
and B, A A B (resp. A\/ B) is the largest (resp. smallest) partition which 
refines (resp. is refined by) both A and B. Under these operations, the 
partially ordered set P(fc) is a lattice. We denote by 1^ the largest partition 
of [k] (one-block partition), and by 0^ the smallest one (A;-blocks partition). 
For A,B e V{k) with ^ < S we denote by [A, B] the interval 

[A, B\ = {C a V{k) \A<C<B}. 

Since we will make some use of the Mobius function for partitions, let us just 
recall ([2Sj Sect 3.6) that for two real functions /, g defined on {{A,B) G 



We will deal with the symplectic case in a forthcoming paper. 
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V{k) X V{k);A < B}, we have: 

f{A,B)= J2 9{A,C) (2.1) 

CelA,B] 
if and only if 

giA,B)= Yl M6h{C,B)fiA,C) (2.2) 

CelA,B] 
with 

M6h{C,B):=l{{{-ly-H^-lyY' 

i 

where pi is the number of blocks of B that contain exactly i blocks of C. 

Let Sk be the set of permutations on k elements. With a G Sk, we as- 
sociate the set C{a) of its cycles, whose number is denoted by i^{cr). We 
denote by Oo- the partition whose blocks are the cycles of o", or when the 
context is clear, just by a. For vr E Sk, a partition A = (Ai, . . . Ai) of [A;] is 
called vr-invariant if vr leaves invariant each block A^ that is 0,^ < j4 (which 
we just write tt < A). 

Finally, we define M.2k as the set of pairings of [2k], i.e. of partitions 
where each block consists of exactly two elements. It is then convenient to 
encode the set [2k] by 

[2k]^{l,...,k,l,...,k}. 

Given two pairings pi,P2, we define the graph T{pi,p2) as follows. The 
vertex set is [2k] and the edge set consists of the pairs of pi and p2- Let 
loop(pi,p2) the number of connected components of T{pi,p2). 

2.2. Cumulants. For r > 1, Kj. denotes the classical cumulant of order r 
(see [25], |21) p. 215). It is a multilinear function of r variables defined as 
follows: if ai, . . . , Or are random variables, 

Kr{ai, ■ ■ ■ ,0'r) = y^ Mob(C, lr-)Ec(ai, . . . Or) 

CGP(r) 

where for C = {Ci, . . . , Ck} G V{r), 

r 

Ec(oi,...,a,)=J]E(J]aj). (2.3) 

More generally, relative cumulants are defined, for A < B G ^(^) as 

KA,B{ai,--- ,ar)= Yl ^c{ai,--- ,ar)Mdh{C,B). (2.4) 

C€lA,B] 

From the equivalence between ()2.ip and (|2.2p we have, for any A < B G 'P{r) 

Esiai,--- ,ar) = Y '^A,c{ai,--- ,ar) . (2.5) 

CG[A,B] 
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2.3. Matrices. For a matrix M = {Mij)ij<n, we denote by Tr the trace 
and by tr the normalized trace 

n 1 " 

Tr(M) = Y, Ma, tr(M) = 'Yl ^-■ 

For TT G Sk and M = (Mi, . . . M^) a k-tuple of n x n matrices, we set 

TY^(M) = Tr^(Mi,...,Mfc)= J] TY(nM,-). 

cec(7r) jec 

Let s be a fixed integer and let {Mi, . . . ,Ms}„ be a sequence of n x n 
deterministic matrices. We say that {Mi, . . . Ms}„ has a limit distribution 
if there exists a non commutative probability space {A, if) and oi, . . . a^ £ A 
such that for any polynomial p in s non commuting variables, 

lim tr(p(Mi, . . . , M^)) = (p{p{ai, ..., as)). 

n— >oo 

3. The unitary group 

3.1. Preliminary remarks: Some moments. Let U he a Haar dis- 
tributed matrix on U(n) the unitary group of size n. We have the following 
important relations (see [T7], Proposition 4.2.3 and [H]). If Uij is the generic 
element of [/, then the random variable IC/,- ,P follows the beta distribution 
on [0, 1] with parameter (l,n — 1) of density (n — 1)(1 — x)"""^. Thus, 

E|C/,,,f = - , E\Uij\^ = \ , Var |C/,jf = ^''~\. , (3.1) 
n n(n + 1) n^(n + 1) 

and more generally 



,2,_ (n-l)!A;! 



E|C/i,f '= = -^ ^-- . (3.2) 

' ^' (n-l + Zc)! ^ ^ 

If X = |[/ijp and y = |t/i,fcP with k / j, then {X,Y) follows the Dirichlet 
distribution on {0 < x,y,x + y < 1} with parameters (1, 1, n — 2) of density 
(n - l)(n - 2)(1 -X- y)"~3. Thus 

E{\U,,,\'\U,,k\^) = —^. (3.3) 

' n(n + Ij 

Besides, if i 7^ /c, j / ^, 

E(|^ijP|C/fc,,|2) = ^l-. (3.4) 

n^ — 1 

From these relations, we can compute the first moments of Tp g, defined in 

dni). 

Proposition 3.1. The mean and the variance ofTp^q are given by: 

ETp^g = Y, l^l^uf = PQ^Unl'^ = — . (3.5) 
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and 

_ n^-n{p + q)+pq 
ri'^ln^ — 1) 

Assume that p/n — )• s, q/n — )• t, then, 

lim-ETpQ = St , limVarT„„ = st(l - (s + t) + st) = st(l - s)(l - t). 

n n ' n 

Proof: 

^^L = E nuij\^\Uki\^ 

i,k<p,j,l<q 

= Yl JE|c/.jf + Yl nuij\^\uuf 

i<p,j<q i<p,j¥=i<g 

+ Yl nuij\^\Ukj\^ + Y nuij\^\Uki\^ 

i^k<p,j<q ij^kKp.jj^l-Cq 

= pq—, — — TT +pq{i-^)- 



n{n + 1) n{n + 1) 

+p{p- l)q— —rr+pip- l)q{q - 1)- 



' n{n +1) -n? — 1 

p + q {p-l){q- 1) 

P'l ~( 7~v{ + 2 ^ 

n{n + Ij n^ — 1 

This yields ([3SI). 

Remark 3.2. An easy consequence of the above Proposition is 

lim -Tin^j i„jj = st 

n n 

in probability. Actually the convergence is uniform in s,t £ [0, 1] (see section 
5). 

3.2. Combinatorics for the unitary group. Let U(n) denote the unitary 
group of size n endowed with the Haar probability measure. The generic 
element will be denoted by U and its {i,j) coefficient by Uij. In [11], Collins 
and Sniady proved the following integration formula on U(n), see also [8]. 
Let A^^ denote the set of pairings of [2k], pairing each element of [k] with 
an element of [k]. Let G^^"'' be the Gram matrix^ 

Then the unitary Weingarten matrix Wg '"^ is the pseudo inverse of G™"^'. 



The term of Gram matrix comes from the theory of representations of groups and 
algebras, see [TO] . 
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Proposition 3.3. For every choice of indices i = (ii, . . . , i^, ij, . . . , i^) and 

J = (il) • • • ) Jfc> Jij • • • 1 jfc); 

E {U^,n ■ ■ ■ U.,,A,H ■ ■ ■ U^,,,) = E ^f'^r Wg^("Hpi,P2) (3.7) 

where 5f^ (resp. 6?^) is equal to 1 or if i (resp. j) is constant on each pair 
of Pi (resp. P2) or not. 

It is clear that with each pairing p G A^^ we can associate a unique 
a £ Sk such that p = Y\i=iii,o'{i)). It is known that if pi is associated 
with a and p2 with /3, then Wg ^""^(^1,^2) is a function of f3a~^ denoted by 
Wg(n,/3a~^), so that (13.7J) becomes 

E {U^,n ■ ■ ■ U^„,Am ■ ■ ■ U^„r,) = E ^^^^f Wg(n, Pa-') (3.8) 

a,l3eSk 



where 6f = 1 if i(s) = i{a{s)) for every s < k and otherwise. In particular, 
if vr € 5fc , we have 

Wg(n, vr) = E{Uu • • • C/fcfcC/i.(i) • • • U^^ik)) • (3.9) 

The Weingarten functions for k = 1,2 are given by (see [8]): 

Wg(n,(l)) = - 
n 

Wg(n,(l)(2)) = -^, Wg(n,(12)) = - ^ (3.10) 

n^ — 1 nln"^ — 1) 



From these equations, we can recover (j3.3p . (j3.4p . 

We can now state a proposition which is a particular case of [21, Theorem 

3.10]. 

Proposition 3.4. Let U be Haar distributed on U(n). Let D = (Z?i, . . . -D^) 
and D = (Dj, . . ■ D^) be two families of deterministic matrices of size n. 
We set, for 1 <i < r, 

Xi = Tt{D,UDjU*) . 
Then, 

Kr{Xi,...,Xr)= E E^/3--^^Tr„(5)Tr^-l(D) (3.11) 

where in the second sum A £ V{r) is such that 

i3a'' < A and AV (3Va = lr, (3.12) 

and Ca,A are the relative cumulants of the unitary Weingarten function (see 
[TT] ) ■ Moreover, if the sequence {D,D}n has a limit distribution, then for 
r > 3, 

lim K,f.{Xi, . . . ,Xr) = 0. 
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Remark 3.5. When writing Tra(l)) in (13. lip , we consider a as a permu- 
tation acting on [k]. The formula ()3.11jl is not given exactly on this form 
in [21] but in our particular case where Xi = Ti[DiUD-jU*) with the Di de- 
terministic, the formulas are equivalent. We shall prove a similar formula 
in the orthogonal case. 

For the sake of completeness, let us give the meaning of C-j^^a- Let n £ Sr 
and Oj = UiiUi^uy We denote for a vr invariant partition 11 G P(r) 

Sn(vr) :=En(ai,...,ar.), (3.13) 

i.e., owing to (|3.9p 

s 

£^n(vr) = nWgHv^J' (3-14) 

fe=i 

where n = {Vi, . . . , Vs}. Then, if we set 

the summation formula ()2.4p yields 

C^,A= Y. Wg(^|vJ---Wg(7r|yjMob(C,^) (3.15) 

7r<C<A 

and the reverse one (12.51) 



^c(7r)= Yl ^-'^- (2-16) 

AG[7r,C] 

We will use these formulas in the orthogonal case. 

3.3. Computations of the second and fourth cumulants of Tp g. 

3.3.1. The covariance ofTp^q. The fundamental remark is that 

Hp^g = DiUDiU* 

with Di = Ip,Di = Iq, where Ik is the matrix of projection on the k first 
coordinates. Note that Di and Dj are commuting projectors and that if 
p/n — >• s, q/n — )• t, {Di, Di}n has a limit distribution with ai, 02 commuting 
projectors on {A,ip) such that 0102 = ai if s < t and = 02 if t < s, and 
ip{ai) = s,ip{a2) = t. 

Let p,p\q.,q' < n. We now give an application of Proposition 13.41 to the 
computation of cov(Tp^q,Tp/^g/) = K2{Tp^q,Tpi^qi). This can also be done, 
using the computations of Section 13.11 

We set D2 = Ip', D2 = Iq' and apply formula (13. lip to Xi = Tp^q, X2 = Tp'^gi, 
r = 2. The different possibilities for a, (3 and A satisfying (I3.12P are gathered 
in the following table, where and 1 stand for the convenient permutation 
or partitions on [2]: 
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a 


/? 


/3a-^ 


A 











1 


1 





1 


1 





1 


1 


1 


1 


1 





Oor 1 



The relative cumulants are given by (see (|3.10p . ([2 
1^11 1 



Ci,i 



G 



0,1 



Cn 



2' 2 1 111 iN' ^0,0 2 

n^ n^ — 1 w^yw^ — \) n^ 



n{v? — 1) 

The different products of traces are quite obvious, so that plugging into 
(l3Tni . we get 

l^2{Tp,q,Tp,^q,) = (3.17) 

{p f\p'){q' f\q') {pAp')qq' pp'iq^q') pp'q'q' 

•n? — 1 n{n? — 1) n{n'^ — 1) 'n?{TT? — 1) 

In the limit p/n — )• s, q/n — )• t^p' /n — )• s', g'/n — )• t', we get 

\miK2{Tp^q,Tp,^q,) = {s A s'){t A t') - {s A s')tt' - ss' (t A t') + ss'tt' 

= {sAs'-ss'){tAt-tt'). (3.18) 

3.3.2. The fourth cumulant. We now give an estimate for K^[Tpq). From 
(;3TT]) with r = 4, 

KA= Y. J]C^a-i,ATr,(^)Tr^-i(Z)) (3.19) 

a,/3G54 A 

where A runs over the partitions of [4] satisfying condition (j3.12p , and finally 

D,=Ip, Dj = Ig (i < 4) . 

We have now 

TV^_i(Z?) = p*W , Tr„(^) = g#(") . 

In P Cor. 2.9], Collins proved that the order of C/3„-i_a is at most n-^-#(''""')+2#(^). 
Finally, 

From equation (20) in [21j, we see that 

2#(A) + #(a) + #(/3) - #(/3a-i) < 6 
and the expression in ()3.20p is of order 

^-8-#(7r)+2#(A)^#(/3)^#{a) < ^#(;3)^#{a)^-2-#(a)-#{/3) 

< (p/n)#(^)-^(g/n)#(")-ipgn-4 

< p q n~ . 



We conclude that 



K4 = O {p'^q'^n-^) 



(3.21) 
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3.4. Proof of Theorem [mi 

3.4.1. Tightness. According to Bickel and Wichura [5, Theorem 3], since our 
processes are null on the axes, the tightness of the family of distributions of 
Wm is in force as soon as the condition C{(3,j) with /3 > 1 is satisfied (see 
(2), (3) in 0): 



E(|VFH(B)|ti|W^(")(C7)|T2) < {f^{B)f^{fi{C)f^ 



(3.22) 



where 7 = 71 +72 > and /3 = /3i + /32 > 1, i? and C are two adjacent blocks 
in [0, 1]^ and W^'^'{B) denotes the increment of W^'^' around B, given by 



s,t 



for B =]s, s'] x]t, t'], /i is a finite positive measure on [0; 1]^ with continuous 

marginals. 

From Cauchy-Schwarz inequality, (I3.22P is implied by 



E(|T^W(S)|2ti) < (/i(S))2^i 



(3.23) 



Moreover, it is enough to consider blocks whose corner points are in T" 
{f,0<p<n} X {^,0< g<n} (see [5], p. 1665.) 

Let p<p' <n and q < q' < n and B =]f ,^]x]f ,^] 



WW(i3):=A(")(p',g' 



p',q' p',q p,g' Pi9 

p+l<i<p' q+l<i<q' 

If we show that there exists a constant C, such that for all n, 



E 



^i:Up'^<i') 



<c 



{p'-p?{q'-q? 



rr 



(3.24) 



then p.23p is satisfied with 71 = 2, /3i = 1 and ^ is the Lebesgue measure. 

An) 
p' —p,q'~q'' 



Since Ap"g(p', q') has the same distribution as %/ „ „/_„, it is enough to show 



E 



p,q 



Oip'q'n-^) . 



If X is a real random variable, an elementary computation gives 



E{X - KX)^ = K4 + 3«;2 



2 5 



(3.25) 



(3.26) 



where Kr is the r-th cumulant of X. Taking X = Tp^q = Ti DiUDiU*, we 
saw above in (|3.6|) that 



K2 = Var Tpg < 2^r . 



(3.27) 



Gathering ([3:26|) , (13:271) and ([5:21]) we get that (13:25]) is checked, which 
proves the tightness. 
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3.4.2. Finite- dimensional laws. Let {ai)i<k G ^, {si,ti)i<k S [0)1]^- We 
must prove the convergence in distribution of X*-") := ^j^^ aiW^ i. to a 
Gaussian distribution. 
Let us denote pi = \nsi\ , qi = [ntjj . Then 

k k 

X(") = Y. «*^S = E a^[TT{D,UD■U*) - E{Tr{D,UD-U*))] 

i=l i=l 

where A = Ip,, A = Iq^■ 

{Di,Dj,i = 1, . . . A;} are commuting projectors with a hmit distribution 

{lii qi,i = ^, ■■■ k} on a probability space {A, (pi) with (pi^Qi) = Sj, (t>i{qi) = 

ti and QiQj = Qi if Ui < Uj (and = qj otherwise) where Ui = Si for i odd and 

Ui = ti for i even. 

Let r > 3, then 

k 

ii,...,ir=l 
k 

= / ^ ai^ . . . Oj^ Kr ( A j-^ , . . . , A jj, j 

Jl,...,ir = l 

where Xi^ = TT{Di^UDiU*). From Proposition [Ml 

Um K^(Ai,,...,AiJ = 0. (3.28) 

n— >oo 

Now, the second cumulant is given by 

k 

K2(X("),a("))= ^ aiajK2(Tr(At/Af^*),Tr(AC/DjC/*)). 

From (IXTSjl 

limK2(Tr(A^A^''),Tr(D,t/At/'')) 

= {si Asj - SiSj){ti Atj - titj). 

Thus, we get the convergence of X^"'' to a centered Gaussian distribution 
with variance 

k 

y^ aiaj{si A Sj - SiSj){ti A ij - tjtj). 

It fohows that the finite-dimensional laws of the process W^""' converge to 
the finite-dimensional laws of the tied-down Brownian bridge. ■ 

4. The orthogonal case 

4.1. Combinatorics for the orthogonal group. Let 0(n) denote the 
orthogonal group of size n endowed with the Haar probability measure. 
The generic element will be denoted by O and its {i,j) coefficient by Oij. In 
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[llj . Collins and Sniady proved the following integration formula on 0(n), 
see also [101 Theorem 2.1] for the following formulation. Let G®^") be the 
Gram matri^o 

where A^2fc is the set of pairings of [2A;] defined in Section 2.1. Then, the 
orthogonal Weingarten matrix Wg '^"'•* is the pseudo inverse of G^"^ . 



Proposition 4.1. For every choice of indices i = (ii, . . . ,Zfc,zj, . . . ,i^) and 

J = (il; • • • ; Jfc) j'l) • • • ) Jfc); 

E (O,,, . . . 0.,,,0.,,. . . . 0.,,J = j; <5f^<5f WgO(«)(pi,p2) (4.1) 

Pi,P2eM2fc 

where 6?^ (resp. 5?^) is e^ua/ to 1 or if i (resp. j) is constant on each pair 
of Pi (resp. P2) or not. 

We now identify A^2fc as the quotient set S2k/Hk where Hf^ is a sub- 
group of S2k known as the hyperoctahedral group and defined as follows 
(see [H] and [6j). With each g £ S2k, we associate the product of disjoint 
transpositions: 

k 

vig) = 11(90) gii)) , 
1=1 

which can be identified as an element of A^2fc- 

We set 7 = nj=i(* ^) and define Hk = {5 G S2k,ig = 9l}, the centralizer 
of 7. We have the following equivalence 

Tl{g) = ^{9) ^^ 3/i e Hk,g = g'h , 

implying M2k - S2k/Hk. 

According to Proposition 3.3 in [11], see also [lU], Wg®'^"^(r/(g'i),r/((72)) 
depends only on the conjugacy class of r]{gi)ri{g2) and we can define the 
orthogonal Weingarten function of S2k^ denoted by WA®*-"-* (see [H p. 511]) 
by 

T^A®W(5)=Wg®(")(7?(/d),r?(5)) 

and we have 

Wg®(")(7?(gi),r?(g2)) = WA°'W(5r'52). 

In the sequel, we shall drop the superscript 0(n) keeping in mind for the 

asymptotics that WK depends on the size n. 

It is clear from the definitions that WA is invariant on the classes of the 



See footnote 1. 



TRUNCATIONS, TRACES AND BIVARIATE BROWNIAN BRIDGE 13 

double coset space Hk\S2k/Hk- 
Then, formula (j4.ip can be written as 

E (O,,, . . . 0,,,0,,,, . . . 0.,,J = ^ E ^'^''^^f'^ WA(5r^52). 

9i,52e52fe 

(4.2) 
We now describe the generators of S2k/ H^ following the presentation in 
|15| . (see also [Sj with a slightly different definition for particular permuta- 
tions). For e = (ei, . . . , efc) G { — 1, l}'^, we define r^ by 

Te = n (^^) ^ ^^■ 

i,ei = -l 

For TT € 5fc, we define tj^ € S2k by 



t^(i) = i; tj,(i) = 7r(z) . 

We shall now parametrize S2k/Hk using special permutations. 

Definition 4.2. A pair (e, vr) G {—1, 1} x Sk is particular if, for any cycle 
c of vr, we have e^ = 1 where i is the smallest element of c. We say that the 
corresponding permutation g^^^^ := T^t-,^ in S2k is particular. 

Proposition 4.3. (see Theorem 8 in [ll]j The class S2k/ Hk containing 
Tft-jt has exactely 2*'^^^ elements of the form, T^it^^/ . Every class of S2k/Hk 
contains exactely one particular permutation of the form T^tj^. There are 
^^ particular permutations gi = r^it-i^i, I < i2Ft^- 

Let S G S2k- From the above Proposition, there exists a particular pair 
(e,(7) such that S = T^t^jh with h S Hk- In particular, 

S ~ t, in Hk\S2k/Hk and WA(S) = WA(t<,). 

We now recall how to find a from S (see |15[ Proposition 18]). First consider 
the pairing 7?(S) and the 2-regular graph r(S) (i.e. with all the cycles having 
even length) defined by 

r(s) = ,?(s)u7?(/d). 

Then, any cycle Tj of length 2qj of r(S) is of the form 

where the ordered couple i z^ is such that i i^ G {i, i} with i = i implies 
i^ = i and i^ = i implies i^ = i. By convention, the starting point of Tj is 
if^ = mm{iji,l < qj}. Set aj = {iji, ... , ijg^). Then cr = O '^j- 

4.2. The variance of Tp g. From Proposition 14. II and the value of the Wein- 
garten function for k = 2 ([H], \W\ Examples 2.1-3.1], see also [H]), we have: 

For i ^ k, j ^ i, 

.2\ _ n + l 



^{of.ol 



n{n + 2){n- 1) ' 



14 C. DONATI-MARTIN AND A. ROUAULT 

For j ^ k 

^ '^ ^^' n(n + 2) 
and 

E0% = -r^-^. 
*^ n{n + 2) 

From these 3 relations, we easily get 

Proposition 4.4. The mean and the variance ofTp^q are given by: 

pq 



ETp^g= Y. EOfj = pqEOl = ^ . (4.3) 

and 



n 
^<p,j<q 



Va.T„^2p, "\7"'^ + ^>+,7 . (4.4) 

n'^ln + 2)[n — 1) 

Assume that p/n — )• s, q/n — )• t, then, 
lim-ETp„ = St , limVarT„„ = 2st(l - (s + t) + st) = 2st(l - s)(l - t). 

n n n 

4.3. Mixed moments of the variables Tp.^q.. As in the unitary case, we 
need to compute cumulants Kr{Xi, . . . Xj.) where the variables Xi are of the 
form 

Xi = TT{DiOD-0-^). 

We shall first establish an analogue of Proposition 13. 4[ We assume in the 
following that the matrices Di are deterministic and symmetric. Even if we 
shall deal later only with diagonal matrices, the computations are the same 
for general matrices. 

Proposition 4.5. Let O be Haar distributed on 0(n). Let D = (Di, . . . Dk) 
and D = (-Dj, . . . D]^) be two families of deterministic and symmetric matri- 
ces of size n. We set, for 1 < i < r, 

X, = TriDiODjO-^). 

Then, 

KriXi,...,Xr)= J2 Xa,f},rY.C,,A'^UD)Tri3-i{D) (4.5) 

(a,/3,e)e<SrX<SrX{±l}'- A 

where in the second sum 

• a £ Sr is a function of a, /3, e satisfying t^-iT^tfs ~ io- in Hj.\S2k/Hk 
see (filH]) . 

• A G V{r) is such that a < A and AV aV (3 = I.,., 

• Co-,A fl'^e the relative cumulants of the orthogonal Weingarten func- 
tion (see [llj ] 

• the combinatorial coefficient Xa,/3,e is 2'""'^'°^"*''^^ 
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Proof: We first give a formula for the mixed moments, following [6l Eq 

(20)]: 

k 

E[flTviD,ODjO-')] = -^ Y, TVA(5-V)M+(5)Afr((5')-i) (4.6) 

where the it generalized moments M are functions on 52fc, resp. Hk-i\^i 
and iJfc-left invariant: for Y a fc-tuple of random real matrices, 

My{g) = n^^,{Yl'^'\ ■ ■ -Xk"^'^)] if 9 G HkQi 

with Y~^ = y* the transpose of Y . 

Formula (j4.6p follows from ()4.2p and straightforward computations. Since 
the matrices D are symmetric, the moments do not depend of the sequence 
e. Using the parametrisation g = r^-^tah and g' = T^^tph' with h,h' G H}^, 
we can rewrite (14.61) as 



k 

nWTi[DiODjO-^)]= Y. A«,;3,fcVFA(t,-ir,t;3)TV,(D)Tr^-i(D) 

(4.7) 
The coefficient Xa,/3,k comes from the fact that we do not impose the se- 
quences ei and €2 associated with a, resp. /3 to be particular and e = eie2. 
From Proposition 1131 X^^p^k = 2^-#(°)-#('') 

As recalled before, with the triplet (a, /3, e), we can associate a particular 
pair (a, e') such that: 

t^^lT^tp = Te't^h (4.8) 

with h£ H. Then, ^K{t^-iT^tp) = WA(t<^), denoted below by WA(cr). In 
the following, we will denote by a := a{a, /?, e) the permutation constructed 
above. 

We now compute the cumulant, following the same scheme as in [21j. Let 
C = {Vi, . . . Vfc} S Vir). We denote by Sy. the permutations on Vi. 



k 

■^ I TT X, 



W.c{Xi,...,Xr)=\{^\ \{Xj 

k 

(ai,ft,ei)65v. x5v.x{±l}l^il;j<fc *=1 

. . . TV„, [D) Tr^-i {D)... Tr,, (D) Tr^-i [D) 

Y. A,,;3,,WAc(cT)Tr,(Z))Tr^-i(^) 

(a,/3,e) G5r XcSr X {±1}'^ 
a,/3< C 
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where a G Sr is such that a < C and (see [HI section 3.4]) 

k 

i=l 

ColUns and Sniady defined the cumulants of orthogonal Weingarten func- 
tions that we will denote by C^^a for A a partition cr-invariant. They satisfy 
like (|3J5]) and (|3J6]) : 

WAc((t)= Y. C'-.^- 

Ae[a,C] 

Thus, 

Ec{Xi,...Xr)= Yl ^"Ar Yl a,ATr,(D)Tr/3-i(^). 

eG{±lY 
Now, 

Kr{Xi, . . . ,Xr) 

= ^Mob(C,l,)Ec(Xi,...X,) 
c 

= ^Mob(C,l,) Y V/3,r- Y C'.,ATr,(Z))Tr^-i(£») 

c (a, /?, e) G 5^ X 5^ X {il}'' ^eKC] 

a,/3< C 

Y Kp,rY Yl Mob(C,l,)a,ATV„(I))Tr^-i(D) 

(a,/3,e)g5rX5r.x{±l}'- a-<A {C;A,a,l3<C'} 

Y ^"=/3>- Z] a,ATr,(D)Tr^-i(D) 

(a,/3,e)e5rX5rX{±l}'- cr<A;ylVaV^=lr 

where the last equality follows from 

v^ ,.-, /^ -, ^ f 1 if^VaV/3 = 1,., ^ 

^ Mob(C,l,) = <^ n .K ■ ° 

C;a7^0<c I otherwise. 

We now study the asymptotic of (|4.5p when n — )• oo. We assume that 
the family of n x n matrices (-Dj) has a limit distribution. It is known (see 
[TTl Theorem 3.16]) that the order of C^,a is n-2'^-#('")+2#(^). In [llj, the 
asymptotic of the cumulant is given in terms of a metric I on pairings. We 
use that l{Pa,Pld) = |c| := r — #{cr) where Po- = YliijO'ii)) is the pairing 
associated with a and pid = 7. 
Now, 



a < A and AVaV /3 = lr ^^'^^ 
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Therefore, for given a, /3, e, the corresponding term in the cumulant is of 
order 

^-2r~#{a)+2#(A)+#{Q)+#(/3) ^ 

where a and A satify the conditions quoted in Proposition 14.51 i-6- 

(T is the permutation defined by 

L,. 

Proposition 4.6. Under the conditions (14. 9p . for r > 3, 

-2r- #(a) + 2#{A) + #(a) + #(/3) + 1 < . (4.10) 

Corollary 4.7. Let {Di,i £ [2r]}„ be a sequence of deterministic and sym- 
metric matrices of size n which has a limit distribution and Xi = Tr^DiODiO' 
For r > 3, 

hm Kr{Xi,...,Xr)=0 (4.11) 

n— >-oo 

We first recall the following lemma (see |21j and the proof therein for the 
second assertion below). 

Lemma 4.8. For A,B€z V{k) we have 

#(A)+#(S)<A; + #(^VS). 

Moreover, if there exists a block Ai of A and Bj of B such that ^{AiCiBj) = 
I, then, 

#{A) + #{B)<k-l + l + #{AyB). 

Proof of Proposition 14.61 From the above lemma and Condition ()4.9p . 
we have: 

#(a) + #(/?)< r + #(a V /?) , (4.12) 

#(A) + #(aV/3)<r + l, (4.13) 

#(A)<#(a). (4.14) 

The proof relies on the following property: 

Lemma 4.9. If a or (3 has a fixed point, then there is a strict inequality in 
KT3\\ or in mTHh 

Proof of Lemma 14.91 We denote by S the permutation of S2r given by 

ta-lTetp. 

1) Assume that i is a fixed point of a and /?. Then (S(i), S(f)) = (i, i) or 
(i, i) depending on the sign of e{i) and therefore, z is a fixed point of a. In 
this case, aV aV (3 ^ Ir and therefore #{A) < #(o-). 

2) Assume that z is a fixed point of /3 and a{i) ^ i. Then {S(i), S(z)} = 
{i, a~^{i)} and therefore the elements {i, a~^{i)} are in the same cycle of a 
(thus in the same block of A), thery are obviously in the same block of a. 
Prom Lemma 14.8^ the inequality is strict in ()4.13p . 

3) Assume that z is a fixed point of a and /3(i) ^ i. 
T,{f3~^{i)) = i ox i according to the sign of ej and 

S(^-i(i)) = /3~i(i) or a-i^-i(i). 
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Thus, we find two distinct elements (i,/3~^(i)) (or (i, a~^/3~^(i))) belonging 
to a cycle of a (thus to the same block of A) and belonging to a block of 
aV/3 (which is /3~^-invariant and a~^/3~"'^-invariant). Therefore, the inequal- 
ity (14131) is strict. D 

Let a and /3 two permutations in Sr- If #(«) + #(/3) < r — 2 + jj^{a\/ 13), 
then, (I4.10p is satisfied, using (I4.13P and (14.14p . From (I4.12J) . it remains to 
study the two cases: 

l)#(a) + #(/3)=r + #(aV/3), 

2)#(a) + #(/3)=r-l + #(aV/3). 
Case 1) It is not difficult to see that in this case, there exist two different 
fixed points for a or j3. For example, a unique fixed point for both a and j3 
would imply: 

#(a) + #(/3) < 1 + ^ + 1 + ^ = r + 1. 

This is not possible since in this case, a V /3 has at least two blocks. So, let 
i ^ j the two fixed points. Several situations can occur: 

a) i, J are fixed points of both a and /3. Then, as seen above, i, j are fixed 
points of a. In this case, #(A) < #(o") — 2, leading to (j4.10p . 

b) i is a fixed point of a and (3 and j is a fixed point of one of them. From 
the previous Lemma, 

#{A) < #{a) - 1 and #{A) + #(a V /3) < r - 1 + 1 = r 

leading to (jiTOj) . 

c) i,j are fixed points of one of the two permutations. For example, i,j 
are fixed points of /?. If ^{i,j,a~^{i),a~^{j)} > 3, then, from Lemmas 14.81 
andSJl it is not difficult to see that #(A) + #(a V/3)<r-2 + l (either 
a block of a and a block of a have 3 common points or two blocks of a and 
two blocks of a have two common points, etc.), leading to (|4.10|) . 

If #{i, J, a~^(i),a~^(j)} = 2, in this case, a and a have a 2-cycle (i,j). This 
yields #(A) + #(a V /3) < r - 1 + 1 but we also have #{A) < #(cr) since 
o" V (a V /3) 7^ Ij.. The other cases are similar, leading to 

-#{a) + 2#(^) + #(aV/3)<r-2 + l = r-l 

proving (|4.10p . 

Case 2): #(a) + #(/3) = r - 1 + #(a V ^). If there exists a fixed point, 
then one of the inequality in (I4.13P or (I4.14p is strict and we are done. If 
there is no fixed point, this implies that r is even, #(a) = #(/3) = § and 
a V /3 = Ir- An equality in ()4.13p is true only for A = Or, the partition in 
singletons. This would imply that a = Id. Let i < r. 



Y,{i)=iora ^(i) and S(i) = /3(i) or a ^P{^)- 

Therefore, a = Id implies that a~^/3(i) = i or a~^{i) = f3{i) and a and /3 
have a common 2-cycle. This is not possible (a V /3 = 1^) except if r = 2. 

D. 
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4.4. The fourth cumulant. We give an estimate for ^^{Tp^q). From the 
previous section, 

K4{Tp,g)= Yl ^"-/3.4 Yl a,ATr«P)TY^-ip) 

{a,/3,e)e54x54X{±l}4 yl;AVaV^=l4 

where D = {Ip, Ip, Ip, Ip) and D = {Ig, Iq,Ig,Iq). From the asymptotic 
behavior of the cumulant, each term is of order 

^-8-#(a)+2#(A)^#(a)^#(/3) (-4^J5^) 



where a, A, a, (3 satisfy condition (|4.9p . 

First assume that #(a) = 7^(/3) = 1. Then the order of (I4.15P is at most: 

pq ^ pV 

Now assume that a or /3 has at least two blocks. From Proposition 14. 6^ the 
order of (j4.15p is at most 

^-l-#(a)-#(/3)p#(a)^#(/3)_ 

It is easy to see that this is at most of order ^^-^. For example, a and /3 has 
at least two blocks, 

2 2 

In the remaining cases, we find a majoration by 2^ or 2-*^ Therefore, we 
obtain 

K,{Tp,g) = O (^) . (4.16) 

4.5. Proof of Theorem 11.11 The proof is similar to the proof in the uni- 
tary case, using the asymptotic vanishing cumulants of order r > 3 (Corol- 
lary H??!) and the estimate (j4.16p for the fourth cumulant, ensuring the tight- 
ness of the family of distributions. 

5. Complementary remarks 

1) Since the sup norm is continuous for the Skorokhod topology. Theorem 
11.11 implies that 

sup |VF(")(s,t)|^ sup \W^^\s,t)\ 

s,tG[0,l] s,t£[0,l] 

in distribution, which implies that 

sup |-%sj,[ntj -St\-^0 (5.1) 

s,tG[0,l] " 

in probability. 
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2) The definition of our process focusses on tlie trace of a random matrix 
Hp^q. This trace is a hnear statistic of its empirical spectral distribution, i.e. 



Tp^g = TiHp^q =p xdfx{x) , 



where 

p 



1 



^ k=i 

and the A^'s are the eigenvalues of Hp^q. If we are interested only in marginals 
{p = [ns\ , q = [nt\ , with s,t S (0, 1) fixed), we can look directly at the as- 
ymptotic behavior of /j, when n — )• oo and then deduce results from the 
continuity of the mapping ^ i— )• J xdfi{x) on A^i([0, 1]). It is known that, 
ii p < q and p + q < n, the random matrix Hp^q belongs to the Jacobi uni- 
tary/orthogonal ensemble ([9] Theorem 2.2, [Ij Prop. 4.1.4), which entails 
that the joint distribution of eigenvalues has a density proportional to 

f[X'^-\l-X,f-^ H \X,-X^f (5.2) 

fc=i i<j<i<p 

where a = {q — p+1)^ and b = (n — p — q + l)'^. The sequence of empirical 
spectral distributions converges to the generalized Kesten-McKay distribu- 
tion. When s < min(t, 1 — t), this distribution has a density which can 
be parametrized by s,t or by the endpoints of its support (n_,u_|_) with 
< u_ < n+ < 1: 

7ru.,uM = Cu_,u^ ^ _ + (5.3) 



where 



Cutu+ •= 2 -^ ~ ^/u-u+ - \/(l - u_)(l - «+) 



The relation between (s, t) and u± is 



u± 



,Js{l-t)±,J{l-s)t 



By continuity, in all cases, we recover a weak form of ()5.ip . i.e. 

\mi-T\ns\,\nt\ =S XTTu_.u+{x)dx = St, 
n n J 

in probability. 

It could also be possible to recover the limiting fluctuations of the marginal 
distribution of T'|^„sJ,[ntJ with s,t fixed, i.e. 

Tlns\,[nt\ - ^T^ns\,[nti ^ AA(0, -s(l - s)t{l - t)) 

from the known results on the fluctuations of linear statistics of /x. Actually, 
the result of Johansson [19] is not specific of the Jacobi ensemble, but uses 
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a model of random matrices invariant by conjugation, with polynomial ex- 
ternal field. Here, the ensemble is invariant but the potential is logarithmic 
(see (fO]) ). 

The result is a Gaussian limit with the good variance. 

At another level, in the same asymptotics as above, Hiai and Petz |16j 
proved that the family of empirical spectral distributions satisfies the Large 
Deviation Principle in A^i([0, 1]) with speed /3n^/2 and good rate function, 
which in the case s < t < 1/2 is 

T{v) = —s I log\x — y\di'{x)di'{y) 

((1 - s - t) log(l -x) + {t-s) log x) dv{x) + Io{s, t) . 



where Io(s,t) is some constant (the limiting free energy). Appealing again 
to the continuity of the mean, we deduce from the contraction principle that 
'n-~^T^nsi,lnt\ satisfies the LDP at scale n~^ with good rate function 

1(c) =inf{X(z^);z^G A^i( [0,1]), / xdu{x) = c} . 

Jo 

3) In multivariate (real) analysis of variance, the random variable Tp^g is 
known as the Bartlett-Nanda-Pillai statistics. The exact distribution of 
Tp^q is known by its Laplace transform which is an hypergeometric func- 
tion of matrix argument ([22] p. 479). Various asymptotic studies have been 
performed, essentially p,q fixed, n — >• oo (large sample framework), or high- 
dimensional framework with q fixed, n,p — t- oo and p/n — )• s < 1 (see for in- 
stance |14j). The asymptotic regime of the present paper {p/n — )• s, q/n — )• t) 
is considered in Section 4.4 of the book [2] and a CLT for the statistic Tp^g 
may be deduced from Theorem 2.2 of [3]. 
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